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ABSTRACT: 

A  novel  strategy  for  automated  screening  of  reconnaissance  imagery 
has  been  formulated  based  on  the  exploitation  of  digital  terrain  data, 
map-to-image  correspondence  and  explicit  representation  of  map,  terrain 
and  sensor  knowledge.  These  concepts  address  the  emerging  battlefield 
situation  where  the  ability  to  acquire  timely  reconnaissance  data  from  a 
diverse  set  of  sensors  far  exceeds  the  capacity  to  interpret  the  imagery. 
Exploitation  of  digital  map  and  intelligence  data  present  important  oppor¬ 
tunities  to  simplify  and  improve  computer-assisted  and  automated  image 
analysis. 

One  set  of  technical  issues  concerns  implementation  of  map-to-image 
correspondence  for  various  reconnaissance  sensors  including  conventional 
mapping  and  reconnaissance  cameras  and  synthetic  aperture  radar  (SAR)  sys¬ 
tems.  Here,  a  deterministic  approach  is  used  to  implement  geometric  con¬ 
straints  based  on  rigorous  sensor  models,  routine  recovery  of  acquisition 
parameters  and  three-dimensional  digital  map  data.  This  is  a  general 
approach  which  will  support  processing  of  image  data  acquired  from  ground, 
airborne  and  spaceborne  platforms. 

A  second  set  of  Issues  centers  on  adequate  knowledge  renresentation 
to  support  a  generate-and- test  strategy  based  on  prediction  of  plausible 
signals  for  anticipated  terrain  features  and  objects  in  the  absence  of 
significant  change.  In  this  case,  a  family  of  frame-based  systems  are  pro 
posed  to  capture  shallow,  but  critical,  representations  of  knowledge  con¬ 
cerning  the  digital  map,  terrain  components,  sensor  and  mission  parameters. 
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AUTOMATED  SCREENING  OF  RECONNAISSANCE  IMAGERY  (U) 


GEORGE  E.  LUKES  . 

U.S.  ARMY  ENGINEER  TOPOGRAPHIC  LABORATORIES 
FORT  BELVOIR,  Virginia  22060-5546 


SIGNIFICANCE  OF  AUTOMATED  SCREENING 

Automated  analysis  of  remotely  sensed  Imagery  represents  an  elusive 
goal  that  has  been  pursued  by  many  for  two  decades.  The  motivation  for 
extensive  research  activity  in  both  the  military  and  civil  sectors  is  ob¬ 
vious.  Since  World  War  II,  there  has  been  tremendous  progress  in  the 
development  of  diverse  image  acquisition  systems  now  flown  on  a  variety 
of  airborne  and  spaceborne  platforms.  The  civil  National  High  Altitude 
(aerial  photography)  Program  and  the  National  (radar)  Mapping  Program  man¬ 
aged  by  the  U.S.  Geological  Survey  and  the  NASA  Lunar  Mapping,  Landsat, 
Shuttle  Imaging  Radar  and  Large  Format  Camera  Programs  provide  good  illus¬ 
trations  of  the  diversity  and  capabilities  of  modern  mapping  and  recon¬ 
naissance  systems.  Simply  stated,  considerable  technological  success  in 
fielding  image  acquisition  systems  has  led  to,  an  abundance  of  image  data 
which  far  surpasses  existing  or  planned  image  exploitation  capabilities  in 
both  the  civil  and  military  sectors. 

This  problem  has  grown  dramatically  with  the  successful  development 
of  electronic  Imaging  systems  with  capabilities  to  transmit  image  data  in 
real-time  to  ground  receiving  stations.  Unclassified  meteorological  and 
earth  resources  satellite  systems,  for  example,  operate  in  the  visible, 
near-infrared,  thermal -infra red  and  microwave  regions  of  the  spectrum, 
often  as  multichannel,  multispectra 1  imaging  systems.  Such  systems  create 
new  opportunities  for  near-real-time  image  exploitation.  These  systems 
have  also  increased  the  volume  of  acquired  imagery  dramatically;  moreover, 
the  perishability  of  much  of  this  data  introduces  serious  time  constraints 
which  add  another  dimension  to  the  image  exploitation  dilemma. 

In  almost  all  significant  problem  domains,  human  image  interpretation 
techniques  currently  represent  the  state-of-the-art  for  extracting  useful 
information  from  linage  data.  Given  the  growing  abundance  of  image  data, 
however,  few  have  advocated  significant  expansion  of  existing  manual  image 
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interpretation  staffs.  On  the  other  hand,  the  emergence  of  the  digital 
computer  led  to  significant  investments  in  earth  resources,  mapping  and 
military  reconnaissance  research  programs  in  pursuit  of  automated  image 
interpretation  capabilities.  After  twenty  years  of  research  activity,  the 
results  of  these  efforts  can  be  characterized  as  occasionally  demonstrating 
partial  success  in  limited  problem  domains  under  restricted  conditions.  It 
is  the  premise  of  this  paper  that  automated  image  interpretation  research 
has  been  driven  by  ambitious  objectives  that  have  consistently  underesti¬ 
mated  the  difficulty  of  the  problem;  further  most  efforts  have  emphasized 
the  extension  of  fragile  methods  to  large  volumes  of  diverse  image  data 
that  is  both  highly  variable  and  complex.  Clearly,  new  approaches  are 
required. 

An  alternative  strategy  is  to  pursue  opportunities  to  enhance  the  pro¬ 
ductivity  of  human  image  interpretation  specialists.  One  approach,  the 
development  of  computer-assisted  Interpretation  techniques  to  aid  the 
image  analyst  directly,  represents  a  significant  objective  of  the  research 
and  development  program  at  USAETL  in  support  of  the  Field  Army  and  the 
Oefense  Happing  Agency  (8).  A  second  approach  is  to  pursue  the  develop¬ 
ment  of  automated  techniques  with  limited  goals  to  reduce  or  prioritize 
the  volume  of  imagery  presented  to  the  human  analyst.  This  process  is 
termed  automated  screening. 

Ideally,  an  automated  image  screening  process  tailored  to  a  specific 
application  would  detect  and  rank  all  significant  components  in  a  set  of 
Imagery  for  subsequent  analysis  by  a  domain  specialist.  The  value  of  the 
concept  is  that  far  less  capable  performance  can  be  of  considerable  bene¬ 
fit.  An  automated  screening  process  that  would  reliably  eliminate  some 
significant  fraction  of  the  image  inventory  from  further  analysis  would 
have  immediate  and  profound  operational  impact.  This  is  a  non-trivial 
objective,  but  one  that  Is  far  less  demanding  than  the  goal  to  fully  auto¬ 
mate  the  image  interpretation  process  which  has  dominated  past  efforts. 

The  sections  that  follow  Introduce  two  well-known  approaches  to  the 
automated  screening  problem,  image-to-image  comparison  and  statistical 
pattern  recognition,  and  suggest  inherent  limitations  in  each  technique  as 
applied  to  reconnaissance  Imagery.  Opportunities  to  simplify  the  problem 
based  on  exploitation  of  digital  terrain  and  intelligence  data  will  then 
be  introduced.  Ongoing  research  to  explore  these  opportunities  emphasiz¬ 
ing  the  concept  of  map-to-image  correspondence  and  explicit  representation 
of  map,  terrain,  sensor  and  mission  knowledge  will  be  presented.  General 
trends  relevant  to  this  problem  will  be  reviewed  and  selected  management 
Issues  will  be  highlighted. 
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TYPICAL  APPROACHES  TO  IMAGE  SCREENING 

Research  in  automated  screening  has  been  dominated  by  approaches 
grounded  in  image  processing  and  statistical  pattern  recognition  based  on 
techniques  that  have  been  successfully  applied  to  other,  less  demanding 
tasks.  Both  share  the  characteristic  and  limitation  of  operating  on  two- 
dimensional  image  data  without  considering  the  inherent  three-dimensional 
geometry  of  the  scene  and  the  imaging  geometry  of  the  sensor. 

Imaqe-to-Imaqe  Comparison 

The  well-known  image  processing  approach  to  automated  image  screening 
is  change  detection  based  on  direct  comparison  of  a  new  image  with  a  pre¬ 
viously  acquired  reference  image.  The  assumption  is  that  precise  regis¬ 
tration  of  two  digital  images,  picture  element  (pixel)  for  picture  element, 
will  permit  the  simple  substraction  of  one  image  from  the  other  to  create 
a  new  image  where  only  the  changes  are  evident. 

Considerable  effort  has  been  directed  towards  the  development  of 
effective  Image  registration  techniques  (2,3).  Although  computationally 
intensive,  these  techniques  are  well-suited  for  Implementation  on  special- 
purpose  hardware  or  parallel  processors.  Good  performance  has  been  demon¬ 
strated  as  long  as  the  inherent  two-dimensional  image  assumptions  are  not 
stressed;  this  is  the  case  if  both  images  are  obtained  by  the  same  sensor 
from  the  same  approximate  position  and  orientation  such  as  Landsat  multi- 
spectral  imagery,  or  in  the  special  case  of  flat  terrain.  In  general, 
military  reconnaissance  and  mapping  applications  are  far  more  demanding 
where  the  analysis  of  diverse  imagery  acquired  by  many  different  sensors 
operating  from  a  variety  of  platforms  with  a  wide  range  of  viewpoints  is 
the  norm. 

Under  such  conditions,  obtaining  precise  correspondence  between  two 
dissimilar  digital  images  is  difficult  at  best.  Modest  errors  in  geo¬ 
metric  registration  generate  many  "false  alarms*  which  degrade  performance 
and  lead  to  requirements  for  considerable  post-processing.  Even  in  ideal 
cases,  the  approach  is  highly  vulnerable  to  temporal  variability.  Natural 
changes  In  scene  illumination,  soil  moisture,  snow  cover  or  natural  vege¬ 
tation  state  are  detected  which  are  often  irrelevant  to  specific  Inter¬ 
pretation  tasks. 

Statistical  Pattern  Recognition 

Application  of  statistical  pattern  recognition  techniques  to  image 
data  is  also  well-known  (4,14)  and  extensively  investigated.  A  problem- 
specific  feature  extraction  process  Is  required  to  represent  each  picture 
element  in  an  imaqe  bv  a  set  Of  measurements,  often  multisnertral  or 
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intensity/ texture  measures,  as  a  multi-dimensional  feature  vector.  In 
some  mathematical  fashion,  the  multi-dimensional  feature  space  is  parti¬ 
tioned  to  uniquely  represent  the  set  of  classes  to  be  identified.  Any 
unknown  feature  vector  can  be  assigned  to  the  class  corresponding  to  its 
position  in  feature  space. 

Statistical  pattern  recognition  approaches  have  proven  to  be  very  use¬ 
ful  in  applied  tasks  where  a  stable,  well-behaved  feature  space  can  be 
established  and  effectively  partitioned.  Considerable  success  has  been 
demonstrated  in  some  highly  constrained  two-dimensional  industrial  inspec¬ 
tion  problems  and  several  products  are  commercially  available.  Automated 
analysis  of  reconnaissance  and  mapping  imagery,  however,  has  met  with  lit¬ 
tle  success  with  the  notable  exception  of  automated  cloud  screening  (7j,  a 
relatively  simple  problem. 

The  difficulties  item  from  the  .complexity  and  variability  of  both  the 
terrain  and  objects  operating  on  the  terrain.  Sources  of  temporal  vari¬ 
ability  noted  previously  with  regard  to  image-to-image  comparison  also 
degrade  the  performance  of  pattern  recognition  algorithms.  Shadows,  dif¬ 
ferential  illumination  and  a  variety  of  other  diurnal,  seasonal  and  aperi¬ 
odic  phenomenon  all  contribute  to  terrain  variability.  Identification  of 
three-dimensional  targets  on  the  terrain  is  complicated  by  differential 
scale,  variable  aspect  and  rotation  introduced  by  the  wide  range  imaging 
conditions  that  characterize  two-dimensional  reconnaissance  imagery.  Fi¬ 
nally,  targets  are  embedded,  often  partially  obscured,  within  the  terrain 
background.  In  the  past,  system  designers  have  often  treated  target 
detection  as  a  “signal-to-noise"  problem  where  the  terrain  background  has 
been  modeled  simply  as  undifferentiated  "clutter." 

APPROACHES  TO  SIMPLIFY  THE  PROBLEM 

When  the  techniques  of  image- to-iroage  comparison  and  statistical 
pattern  recognition  were  initially  Investigated  for  automated  screening 
of  digital  imagery,  they  appeared  to  be  sophisticated  processes.  In  retro¬ 
spect,  they  can  now  be  characterized  as  simple  approaches  to  a  complex  set 
of  problems.  Additional  sources  of  information  are  needed  to  constrain 
and  simplify  these  tasks.  Fortunately,  a  number  of  new  opportunities  can 
be  considered  based  on  the  availability  of  digital  map  data,  the  exploi¬ 
tation  of  analytical  sensor  models  and  the  concept  of  map-to-image  corre¬ 
spondence  (8,9). 


Map-to-Image  Correspondence 


Analytical  techniques  developed  to  support  the  generation  of  digital 
map  data  from  stereoscopic  Imagery  can  be  exploited  to  automatically  pro¬ 
ject  previously  compiled  digital  map  data  into  reconnaissance  Imagery. 
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Photogrammetrists  refer  to  this  operation  as  projection;  computer  vision 
researchers  have  adopted  the  term  map-to-image  correspondence.  Prereq¬ 
uisites  for  map-to-image  correspondence  include  an  analytical  sensor  model 
for  the  imaging  system,  routine  recovery  of  image  acquisition  parameters 
and  the  availability  of  three-dimensional  digital  map  data. 

In  conventional  mapping  practice,  use  of  sensor  models  and  recovery 
of  the  image  acquisition  parameters  are  routine  prerequisites  to  stereo 
mapping  compilation  or  precise  point  positioning.  Additionally,  these 
procedures  provide  a  rigorous  basis  for  automatic  prediction  of  precise 
image  coordinates  corresponding  to  terrestrial  objects  described  by  three- 
dimensional  ground  coordinates  as  a  basis  for  map-guided  scene  analysis. 

Sensor  Model 

Mathematical  .models  have  been  developed  for  mapping  and  reconnais¬ 
sance  sensors  which  analytically  characterize  the  Image  forming  geometry 
of  each  system.  Essentially,  the  simple  mathematical  model  of  the  ideal¬ 
ized  "pinhole"  camera  has  been  generalized  and  extended  to  a  variety  of 
operational  frame  and  dynamic  imaging  devices.  Non-perspective  imaging 
geometries,  particularly  the  range  imaging  geometry  of  syntnetic  aperture 
radar,  have  also  been  successfully  modeled  (12,13). 

Recovery  of  Acquisition  Parameters 

For  a  given  image  or  set  of  images,  recovery  of  image  acquisition 
parameters  which  characterize  the  position  and  attitude  of  the  sensor 
during  the  imaging  event  is  a  standard  photogrammetric  or  radargrammetric 
operation.  These  procedures  are  described  as  block  adjustment  or  triangu¬ 
lation  when  performed  on  multiple  images  and  as  the  resection  of  a  single 
image. 

The  development  of  improved  capabilities  for  monitoring  the  position 
and  attitude  of  acquisition  platforms  including  inertial  navigation  techno¬ 
logy  and  the  Global  Positioning  Satellite  system  provide  new  opportunities 
to  derive  initial  estimates  of  image  acquisition  parameters  automatically. 

Digital  Map  Data 

Generation,  management  and  exploitation  of  digital  map  data  is  the 
major  focus  of  mapping  research  and  development  in  the  world  leading  to  the 
production  and  use  of  digital  elevation  models  (DEM)  and  digital  plani- 
metric  or  feature  data.  Digital  elevation  data  is  inherently  three-dimen¬ 
sional  as  required  for  map-to-image  correspondence.  Existing  planimetric 
data  has  been  largely  derived  from  two-dimensional  manuscripts;  however. 
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three-dimensional  planimetry  can  be  generated  by  interpolating  elevation 
values  from  the  corresponding  DEM.  In  the  future,  direct  data  capture  of 
three-dimensional  planimetry  from  stereoscopic  aerial  photography  using 
analytical  plotters  (8)  will  become  increasingly  common  providing  increas¬ 
ed  photo  interpreter  productivity  and  improved  metric  accuracy. 

Map-Guided  Scene  Analysis 

In  the  near-term,  the  most  valuable  use  of  map-to-image  correspon¬ 
dence  may  lie  in  the  elimination  of  areas  from  manual  image  exploitation 
based  terrain  characteristics  and  military  doctrine.  Interactive  digital 
image  exploitation  in  particular,  supports  and  requires  careful  manage¬ 
ment  of  image  exploitation  assignments  to  maximize  interpreter  throughput. 
In  the  long  run,  several  more  challenging  tasks  can  be  considered  based  on 
direct  utilization  of  digital  map  data  to  support  automated  image  analysis. 

A  digital  map  encodes  an  explicit  model  of  the  shape  and  composition 
of  the  terrain  that  enables  map-guided  analysis  of  the  general  landscape. 

In  the  context  of  mapping  and  terrain  analysis,  this  suggests  the  potential 
for  automated  screening  to  detect  changes  In  terrain  patterns,  such  as 
those  introduced  by  road  building,  land  clearing  or  military  operations, 
given  knowledge  of  the  previous  conditions.  Similarly,  automated  target 
recognition  can  be  pursued  given  an  explicit  characterization  of  the  ter¬ 
rain  background  rather  than  some  generalized  description  of  background 
"clutter." 

In  the  context  of  automated  target  recognition,  digital  map  and 
collateral  Intelligence  data  can  be  used  to  specify  where  to  look  for 
individual  objects  or  classes  of  objects.  Automatically  searching  for 
vehicles  on  or  adjacent  to  roads,  bridging  operations  on  or  adjacent  to 
rivers,  or  monitoring  activity  at  motor  pools  and  depots,  represent 
challenging,  but  constrained,  localized  scene  analysis  tasks. 

Geometric  constraints  can  be  exploited  in  other  ways  to  support  auto¬ 
mated  analysis  of  three-dimensional  objects.  Scale,  aspect,  relief  dis¬ 
placement  or  layover.  Illumination  and  shadows  can  all  be  predicted  for 
terrestrial  objects  given  knowledge  of  the  sensor,  acquisition  parameters 
and  terrain.  In  some  instances,  such  as  road-bound  vehicles  or  docked 
boats,  rotation  uncertainty  can  be  reduced  to  one  or  two  orientations. 

Such  mensuration  tools  represent  some  of  the  analytical  processes  necessary 
to  adequately  interpret  the  two-dimensional  data  recorded  In  images  of 
three-dimensional  objects. 
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AN  EXPERIMENTAL  RESEARCH  PROGRAM 

Concepts  of  map-guided  scene  analysis  for  automated  screening  of 
diverse  mapping  and  reconnaissance  imagery  based  or,  map-to-image  corres¬ 
pondence  are  being  explored  by  the  author  in  an  in-house  research  study 
at  the  USAETL  Research  Institute.  The  study  focuses  on  a  European  test- 
site  situated  west  of  the  city  of  Freiburg  and  east  of  the  Rhine  River  in 
southwestern  West  Germany.  The  area  is  characterized  by  diverse  land  use 
and  is  the  object  of  several  ongoing  remote  sensing  research  programs.  A 
diverse  set  of  digital  map  and  image  data  has  been  assembled. 

Digital  Map  Data 

Selected  digital  map  overlays  were  extracted  from  the  German  1:50,000 
map  sheets  which  serve  as  the  NATO  standard  topographic  maps  for  the  area. 
These  planimetric  files  were  transformed  from  two-dimensional  to  three- 
dimensional  coordinate  data  representations  based  planimetric  augmentation 
using  a  corresponding  digital  elevation  model.  A  plot  of  the  digital  data 
compiled  in  the  transportation  map  including  roads,  railroads,  canals  and 
powerlines  is  shown  in  Figure  1. 

Image  Data 

A  time  sequence  of  aerial  photography  obtained  with  conventional 
frame  cameras  has  been  assembled  representing  several  film  types  and  a 
range  of  photo  scales.  Space  photography  of  the  tests ite  was  initially 
acquired  from  the  Space  Shuttle  using  the  European  Space  Agency  (ESA) 

Metric  Camera  (Freiburg  was  obscured  by  cloud,  cover)  and  later  with  the 
NASA  Large  Format  Camera  (cloud-free  stereo  coverage  was  obtained).  A 
scanning  microdensitometer  at  USAETL  Is  used  to  convert  film  duplication 
imagery  Into  digital  data. 

Synthetic  aperture  radar  (SAR)  imagery  has  been  obtained  over  the 
Freiburg  testsite  during  several  international  experiments.  In  July  1981, 
the  ESA  SAR  580  Campaign  made  an  extensive  set  of  digital  SAR  acquisitions. 
This  study  uses  a  digital  X-band  imagery  acquired  with  a  nominal  ground 
resolution  of  3  meters  as  an  example  of  airborne  SAR  Imagery  (see  Figure 
2).  In  October  1984,  the  site  was  imaged  from  space  during  the  Shuttle 
Imaging  Radar  Experiment  (SIR-B).  Two  digital  images  acquired  during  this 
mission  at  a  nominal  ground  resolution  of  25  meters  provide  experimental 
spaceborne  SAR  Imagery.  Recently,  additional  SAR  imagery  of  the  testsite 
has  been  acquired  by  the  Intera  Corporation  using  the  airborne  STAR-1 
X-band  system. 
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Figure  1.  Freiburg  Testsite  Transportation  Data.  Linear  features 
representing  the  transportation  network  as  compiled  from 
1:50,000  topographic  maps  including  autobahn,  national 
roads,  secondary  roads,  railroads,  canals  and  powerlines. 


Figure  2.  SAR  Image  with  Transportation  Overlay.  Map-to-image 
correspondence  was  used  to  project  transportation 
network  onto  SAR  580  radar  image. 
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Geometric  Constraints 

For  the  digitized  photography,  photogramnetric  procedures  (8)  are 
used  to  recover  the  acquisition  parameters  and  map-to-image  correspon¬ 
dence  is  based  on  the  corresponding  projective  (coll inearity)  equations. 
Experimental  radargrammetric  software  was  modified  to  recover  acquisition 
parameters  of  the  digital  SAR  images  by  space  resection  (9)  and  the  radar 
range  equations  were  adapted  to  support  SAR  map-to-image  correspondence. 
In  both  cases,  the  same  general  procedures  are  applicable  whether  the 
imagery  was  acquired  from  aircraft  or  spacecraft. 


Explicit  Knowledge  Representation 


The  organization  and  maintenance  of  a  heterogeneous  knowledge  base  to 
support  exploitations  of  a  diverse  set  of  digital  map  and  image  data  via 
map-to-image  correspondence  requires  flexible  extensible  data  structures. 
The  concept  of  knowledge  representation  using  frames  is  well  documented  in 
the  artificial  intelligence  literature  and  has  been  used  extensively  in 
computer  vision  research.  For  this  study,  a  family  of  frame-based  systems 
based  on  the  FRL  system  developed  at  MIT  have  been  designed  to  capture 
shallow,  but  critical,  representation  of  knowledge  concerning  the  digital 
map,  terrain  phenomenon,  sensor  and  mission  parameters. 


Useful  knowledge  describing  a  digital  map  includes  relevant  specifi¬ 
cations  and  rules  used  to  compile  the  map,  descriptions  of  the  source 
materials  and  some  measure  of  metric  accuracy.  In  particular,  it  is  essen¬ 
tial  to  encode  the  terrain  patterns  that  can  be  present  within  a  mapped 
feature  due  to  cartographic  generalization.  The  German  forest,  for 
example,  depicted  as  a  homogeneous  unit  on  a  map  is  typically  partitioned 
Into  intensively  managed  compartments;  these  compartments  are  linked  by  a 
network  of  forest  roads  which  may  or  may  not  be  encoded  in  the  map. 


For  automated  screening,  knowledge  of  terrain  phenomenon  focuses  on 
the  phenological  criteria  that  influence  the  state  of  a  terrain  pattern  as 
a  function  of  time.  Obvious  examples  Include  state  of  crops  in  agricul¬ 
tural  fields,  canopy  condition  of  deciduous  forests  and  the  surface  state 
of  standing  water  bodies. 


For  each  sensor  to  be  utilized,  essential  knowledge  includes  instru¬ 
ment  calibration  and  performance  data  as  well  as  explicit  references  to 
the  appropriate  processes,  implemented  in  computer  code,  that  model  the 
image  formation  process.  Image  illumination  phenomenon  and  radiometric 
response  criteria. 


Mission  knowledge  can  include  descriptions  of  the  platform,  sensor 
suite  and  flight  plan  or  mission  trajectory.  At  a  minimum,  explicit 


representation  of  acquisition  parameters  of  position,  orientation  and 
time  is  required  for  each  image  to  be  processed. 

Current  Status 

This  paper  describes  research  in  progress.  The  digital  map  and 
image  data  set  described  above  have  been  installed  on  the  Image  Under¬ 
standing  Testbed  at  USAETL  in  conjunction  with  the  frame-based  knowledge 
representation  system.  Processed  for  map-to-image  correspondence  based  on 
rigorous  photogrammetric  and  radargramroetric  principles  have  been  Imple¬ 
mented.  A  genera te-and- test  strategy  has  been  formulated  to  drive  a 
series  of  automated  screening  experiments.  The  approach  relies  on  pre¬ 
diction  of  plausible  signals  for  given  map  features  expected  to  be  present 
in  a  new  image  in  the  absence  of  significant  change.  Current  efforts  cen¬ 
ter  on  the  implementation  of  a  control  strategy  embedded  within  a  tailored 
frame  system  and  development  of  tfie  specific  domain  knowledge  bases. 

CURRENT  TRENDS 

Issues  raised  In  automated  screening  research  based  on  map-guided 
scene  analysis  are  related  to  a  number  of  current  trends  and  ongoing 
activities.  A  dramatic  increase  in  the  volume  of  reconnaissance  imagery 
was  cited  earlier;  concurrently,  the  Defense  Mapping  Agency  is  producing 
and  distributing  Increased  quantities  of  digital  map  data  in  the  form  of 
standard  Digital  Terrain  Elevation  Data  and  Digital  Feature  Analysis  Data 
products  for  major  landmasses.  Specific  Army  initiatives  in  digital  map¬ 
ping  include  the  development  and  fielding  of  the  Digital  Topographic  Sup¬ 
port  System  (DTSS)  and  the  current  technical  base  program  for  the  Terrain 
Analyst  Work  Station  (TAWS). 

Related  research  activity  is  being  conducted  under  several  Defense 
Advanced  Research  Projects  Agency  (DARPA)  programs.  Significant  appli¬ 
cations  of  map-to~1mage  correspondence  are  being  explored  under  the  Image 
Understanding  Program  with  continuing  efforts  at  Carnegi e-Mel  Ion  Univer¬ 
sity  (10)  and  SRI  International  (5).  Potential  cartographic  applications 
of  image  understanding  techniques  leading  to  improved  interactive  and 
partially  automated  systems  represent  a  major  area  of  interest  in  digital 
mapping  research  today  (11). 

A  new  DARPA  program  entitled  Advanced  Digital  Radar  Image  Exploi¬ 
tation  System  (ADRIES)  is  directed  to  the  development  and  demonstration  of 
an  advanced  technology  base  for  exploitation  of  multi-resolution  SAR 
imagery  (1).  The  program  emphasizes  largely  autonomous  exploitation 
capabilities  with  extensive  use  of  collateral  and  contextual  information 
to  assist  image  analysis.  Maintenance  of  a  digital  spatial  model  of 
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specific  geographic  areas  of  interest  and  map-to-image  correspondence  are 
essential  components  of  the  program.  The  ADRIES  program,  formulated  and 
conducted  with  close  Army  support,  will  lead  to  the  development  of  a  na- 
ional  SAR  research  testbed  facility  at  USAETL. 

The  DARPA  Strategic  Computing  Program,  a  major  national  conmitment  to 
developing  advanced  computational  capabilities,  is  leading  to  the  develop¬ 
ment  of  novel  computer  architectures  and  processing  capabilities  that 
enable  serious  consideration  of  computationally  intensive  tasks  such  as 
automated  screening  of  reconnaissance  imagery.  In  addition,  the  Autono¬ 
mous  Land  Vehicle  demonstration,  described  elsewhere  in  these  proceedings 
(6),  presents  challenging  tasks  for  use  of  digital  map  data  tc  support 
real-time  computer  vision  processes  as  well  as  mission  planning. 

CLOSING  REMARKS 

The  mapping  and  reconnaissance  communities  have  entered  an  age  that 
is  data  rich.  In  the  pursuit  of  techniques  to  process  abundant  image  data 
into  useful  information,  it  is  Important  to  recognize  that  the  only  common 
frame  of  reference  for  these  dissimilar  data  sources  is  a  three-dimen¬ 
sional  model  of  the  world  with  additional  capabilities  to  record  temporal 
change.  In  the  past,  topographers  emphasized  metric  processing  of  imagery 
to  produce  accurate  maps  and  to  direct  weapons  systems;  in  other  image 
exploitation  applications,  positional  accuracies  have  been  less  critical  — 
the  nearest  kilometer  grid  cell  was  often  close  enough.  Today,  technical 
advances  make  it  possible  to  extend  metric  fidelity  to  a  broad  range  of 
Imaging  systems  which  will  create  significant  opportunities  for  computer- 
assisted  and  automated  image  exploitation.  The  Implications  of  this 
observation  are  clear.  Optimized  multisensor  fusion  will  require  analyti¬ 
cally  modeled  and  calibrated  imaging  sensors.  Image  acquisition  parameters 
must  be  recovered  routinely  and  made  available  to  support  image  exploi¬ 
tation.  The  concept  of  the  three-dimensional  digital  map  must  be  general¬ 
ized  to  include  current  situation  data,  analogous  to  the  existing  grease 
pencil  overlays,  to  realize  the  potential  of  our  mapping  and  reconnais¬ 
sance  systems  to  create  and  maintain  a  working  model  of  a  geographic 
area  of  Interest  that  is  current,  flexible  and  responsive. 
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